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ABSTRACT 

A study was conducted in an effort to demonstrate 
the potential usefulness and versatility of immediate feedback for 
direct teacher training. Subjects were two fourth grade teachers who 
wore electronic earphone speakers in their social studies classes. 
One, with 12 years experience, taught geography to each class 
separately in daily 30-minute periods; the other, with one year 
experience, taught history to the classes twice weekly for 20-minute 
periods. Classes were tape recorded for one week to obtain a baseline 
sample of question strategies. Fcr the 3-week intervention phase 
teachers were told that when they set up a situation which encouraged 
the children to use higher level thought processes, that was good, 
and they would be signaled. Feedback was immediately provided for all 
questions above the knowledge category (based on Bloom's taxonomy). 
After 3 weeks of post-experiment recording without feedback, tapes 
were analyzed for questioning strategy. Data indicated that both 
teachers increased their use of high order questions to an acceptable 
level (a larked change in the desired direction) which continued 
during the post-test probes. Results suggest that electronic training 
techniques could economically and effectively supplement the usual 
student experience arid could be used with experienced classroom 
teachers for skill enhancement. (Author/JS) 



llitf 003 



0 



\ 






t 



S BATTLE UHIVBR8XTY 
Seattle, Washington 98122 
APPLIED BEHAVIOR CHANGE PROJECT 



U • DEPARTMENT OP HEALTH. E DUCAT JON 
A WELFARE 
OFFICE OP EOUCATION 
EHJ| DOCUMENT HAS BEEN REPRODUCED 
EXACTLY AS RECEIVED FROM THE PERSON OR 
ORGANIZATION OHIO HATING <T POlNT| OF 
VIEW OR OT.NONS STATED DO NOT NICE* 
SAPliV REPPESINT O e F>ClAl OFFICE OF IOU 
CATION POSITION OR POUCY 



I 



Report 



0 001 l Juno 1969 



Title i 



Authors i 



Raisins tuo level of toachor questions 
by imodiate systematic food bach. 
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Abstracts In an effort to demonstrate the potential usefulness end 
versatility of lmedlate feedback for direct teacher training, two 
fourth grade teachers uoro electronic earphone speakers in social 
studloo olsssee. Mhonovor they used hlQh order queetlonlns strategies 
they wore given lmedlate feedback without disrupting the class. Data 
indicate that both teachars increased their uet of high order questions 
to an accaptablo level aftor three weeks of intervention with feedback, 
Results suggest that electronic training techniques could ueonomlcAliy 
and effectively suppliwent the usual student teaching ouparlance and 
could be used with experienced classroom teachers for skill enhanceaent. 
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RAISING TUB LEVEL OP TEACilBR QUESTIONS 
BY MEDIATE SYSTEMATIC FEEDBACK 
Rosemarie B. McCartln 
Hayden L. Hoes 
Seattle University 

Effective acquisition of the variety of complex skills necessary 
for successful classroom teaching is a subject of basic concern In 
education. There Is evidence from teacnero themselves that ouch of 
their formal college preparation was not directly relevant or helpful 
trhen they wore faced with the classroom situation. Direct experience, 
such as student teaching, which typically lecto olx to eighteen Meeks, 
has been found more useful than much of the more extensive formal course 
work In education (Footllck, 1966), 

Vnfortunatoly, a significant Increase In the aoounc rf direct stu- 
dent teaching experience is probably not a feasible solution. The sheer 
magnitude of tho problem is overwhelming since more than 200, 0C0 new 
teachers are graduated In a year (Footllik, 1966). If the experience of 
student teaching ware extended, the burden of participating schools uoulO 
be Increased unreasonably in many cases, 

furthermore, there Is no .‘.seuranca that i.h* particular classroom 
experience a student teacher would get would be the most useful and 
relevant from the educator's point of view, Evc-:i a master teacher ex- 
pressly chosen to train studui.t teachers would not likely be a master 
in all sreae of teaching. It would bo extremely difficult to prescribe 
oelecttvo experiences with a variety of master teachers who are expert at 
particular skills and not at othors. 

Feedback presents additional problems in etudent teaching. The 
tsUtlve inefficiency involved in tho way students learn about their own 
classroom performance presents severe 1 limitations for the technique* 
of direct training. Tho feedback nay bo specific or generrl, and the 
student may be able to learn desired teaching patterns from the feedback, 
or he may not, perhaps the critical element influencing the effectiveness 
of feedback le tho length of delay between the student teacher's behavior 
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and when the feedback is given. Ordinarily it may be hours or days 
between the student’s actual performance and the feedback he gets. 

Seldom is it seen as possible or desirable to give a studont immediate 
feedback while the actual bohavior Is going on. It would be disruptive 
to 8 top the studont in the ralddlo of a presentation to criticise or 
praise the way material is handled, and Indeed the reactions of both 
student teacher and pupils could bo detrimental to the purpose of the 
classroom oxperlence. To say that the potential for trauma Is great 
would bo an under statomont, especially considering that the typical 
feedback given undot such circumstances tends to be critical or puni- 
tive rather then lcudltory or rewarding. Consequently, feedback about 
performance is delayed so lor.g as to bo of little valuo with regard to 
learning specific teaching skills. 

C J A promising tochulquo /which may ovorcomo the problems of magnitude 
and selective experience, and which , /cvidos imediato feedback for the 
student teachor, has boon made feasible by advances in electronic tech- 
nology. Prompting and immediate feedback without disruption to the class, 

and with minimal disturbance to the student teacher, can be impiemujted 

\ 

tilth radio conmunlcatlon to the student through an earplug speaker,' 

Several variations in the specific equipment include the walkie-talkie, 
the pocket transistor receiver, and tha ’’bug in tho ear" (Schwitsgebel, 
I960). 

Prompting is a technique which has been used to train child workers 
end axpe$ieeT’:'.\c while in an ongoing situation with children. Baer (1961) 
t sported the use of an eorphono receiver to Instruct an adult to moke 
specific statements ’-Ml« i*^::*t:c';:‘.ri; vi. fc h a child, Psychotherapists 
and parents hove ween tea’.,..' -.-re. effectively deal with children 

by following instructions given by a therapist observing from an 
adjoining room (k. A. Sanders, 1966) ttelsh, 1966) Krspfl, et al,, I960). 

lonedlate feedback may be givea in addition to prompting or ae a 
eeparate technique, Patterson, otal, (1965) reinforced quiet class- 
room behavior in a brain- injured hyperactive tea-year-old boy by giving 
him a butfc over his receiver earphone as feedback Mien sitting still. 

Hi* buss indicated that he ern.'-d a piece of candy for quiet, appro- 
priate classroom behavior. 
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\ If a variety of behovloro can bo demonstrably onhancod through 
Immediate feedback, It would appear that the educator has at his die* 
posol a pwrcrful technical Aid to toachor training. Zn order to start 
exploring the utility of Immediate feedback In a cloosroora, It vao 
decided that a significant toachlng skill should bo choson. Con* 
soquontly, tho teacher's questioning stratenioo wore solectod for 
further exploration and study. 

Questioning strategies havo boon classified and studied In relation 
to the Intellectual objectives of education. Bloom's Taxonomy of Ed - 
ucational ObJoctlvos j(1956l| presents a basic closoiflcatory system which 
has been elaborated Into o Hierarchy of complexity and Inclusiveness, 
Assuming that a relationship exlsto botwoan tcachorb' questions and 
children's responsos, there lo oomo agreement that at least Onc-third 
of a teacher's quoctlonc ohould bo comprehension and hlgher-ordor typos, 
as opposed to lowr-ordor knowledge or memory typosj(N, N, Sanders, 1966{ 
Per ley & Clogg, 1967), 

Observations of classroom questioning by elementary teachers at all 
levole Indicates the proportion of lotmr- level questions to be as high as 
9&% for "direct" teachers and about 42% for "Indirect" (Ami don & Ami don, 
1969). 

The types o*. questions asked may be o function of factors other than 
the training given tho teacher regarding questioning strategies. Quite 
possibly the toachor io influenced by the speed and responsivlty of hie 
pupils in the classroom, Memory and knowledge questions elicit o high 
rate of response, which may glvo tho teacher a feeling of accomplishment, 
rapport, and cuccQse, but which may have little value in terms of devel- 
oping the children's thinking skills, A high rate of classroom activity 
may actually amount to no more than "busy twrk," On the other hand, tAien 
things move more slowly end the response rate is not so high, the teacher 
may feel less adequate, but may actually be providing the type of situation 
for tho children to develop higher order cognitive processes, 

f The present study was an effort to test the feasibility of an immediate 
feedback system to strengthen the higher-order questioning skills of two 
fourth grade teachers. Mo effort was made to prompt tho teachers snd 
neither teacher was given any instruction about questioning strategies 
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or the purpose of the study. It was decided that special training could 
be glvon if immediate feedback did not strengthen tho desired skill. 
Essentially the feedback represented a responsive audience rather than 
a guide to questioning strategies, 

Method 

^ Two fourth grado lovol classrooms in a private school were the 
settings for tho study. Each class < f eighteon pupils Is described as 
coming from a relatively homogeneous middle class background^ but their 
work characteristics were described as being markedly different by staff 
and teachers, 

| Of the ttK> fourth grade teachers, Miss X had twelve years teaching 
experience, while Mls9 Y had ono year. Miss X taught geography to each 
class separately in daily thlrty-mlnuto poriods. Miss Y taught history 
to the class:. 8 twlco weokly for tvxmty minute periods. / History and 
geography were selected as the typos of subjects in which questioning 
strategy could be identified and measured. 

Procedure 

History and geography classes were tapo recorded during the first 
week of the study to obtain a sample of the questioning strategies and 
to help the teachers adapt to tho experimental situation. Four Judgos 
Independently sorted questions into categories based on Bloom's Taxonomy . 
Questions were defined in terms of "teacher- initiated verbal behavior 
calling for a pupil response," omitting all procedural questions, state- 
ments, quotations or paraphrases from tho children's text, and items not 
related to the social otudies losson content. Inter- judge agreement 
ranged from seventy- five percent to 1004 , with a nodal agreement of 100T 
for four Judges. (Data from in* i»vst week of monitoring were used os 
baseline, ' 

During the intervention phase of the study, feedback was tnrosd lately 
provided for all questions above the knowledge category. The only In- 
structions provided the teacher wore* "lie are interested in the way 
children think, l.tien you set up a situation \ 4 ilch gets the children 
to use higher levol thought processes, that is nood and we will signal 
you." The signal consisted of o "beep" through an earphone via a walkie- 
talkie worn by the teacher, ' 
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( The teacher's voice wee carried by a small PM transmitter to a 
recolvor in the adjoining room, and was tape-recorded. Usually two 
judges monitored the tcaclior's class and signaled whenever a high- level 
question was asked by the teacher. The intervention phaso lasted three 
i>oe!(s r followed by approximately ono and one-half weeks of no inter- 
vention (partly due to school closure for snow) and thieo \roeke of post ' 
oxporlmental recording without feodlack. ‘ Zn tonne of number of teaching 
periods lnvolvod, Tablo 1 shows that Miss X was monitored for 30 periods, 
of Tillich 16 woro occasions for intervention, Miss Y was monltorod 19 
periods and had 11 intervention periods, The time span was ten woelcs 
from basolino to final post-test probo, including vacation and school 
closuro duo to snow. 



Insert Tablo 1 about hero 



Rosults 

Bach classroom period was analysed from the tapes independently for 
questioning strategy, , A period was Judged to most tho criterion of ade- 
quacy if 33% or mure of the teacher's questions ware considered to fall 
at or abovo tho comprehension level, parcentago of monitored periods 
meeting the criterion was computed on a weekly basis, Table 1 shows the 
similarity of teaching strategies used by both teachers over tho 10 week 
span, ^ 

In goneral, tho more experienced teacher seemed to have more periods 
at tho criterion level in the early stages of the study, hut both teachers 
dropped their lovol of questioning during the second week of intervention. 
This may be due to a change in teaching etyle which seemed to be taking 
plate during this week, Hearing tho communication apparatus ties cumber- 
some and the novolty effects of the experiment had worn off, Subjectively, 
tho teachers reported some discomfort at this time and thero ties an ap- 
parent transition in questioning behavior taking place, the third week 
of intervention was described by the observers as a "breakthrough," 
during which tho tcachors' rates of higher- level questioning picked up 
markedly, The post-test probes showed that tho high level questioning 
strategics continued at a satisfactory rate for the next three weoks 
when the study was terminated. / 
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Conclusion 

Results from this pilot study of the effects of iraaodlete feedback 
on a teachor's questioning strategies indicate a marked change in tho 
desired direction. The chango in porcontago of woekly poriods meeting 
a criterion of highor order questioning shows a similar progression for 
t\K> teachoro having different amounts of tooching experience, oince no 
attompt was made to rovorsr: the direction of questioning strategy or to 
control for other possible oxtroneous effects (6uch as tho school closures) 
tho results are not considered to bo a critical tost of a tochniquo. 
Nevertheless, tho available evidence is compelling and a replication 
of the experiment should indicoto tho reliability of those rosults. 

The versatility offored by electronic doviceo for immediate 
foodback gives tho educator a potentially potrerful technique for 
training student toachorc while in tho teaching situation. This pilot 
study indicates that oxporienccd teachers may also bo effectively 
trained in specific areas of classroom teaching without seriously 
disrupting their ongoing teaching situation. 
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Table 1 

Number of Teaching Periods Monitored and percent of Periods 
Meeting Minimal Standards of Questioning Over a Ten Week Span 
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a Baserates , no intervention, 
b School closed for holidays, 
c Intervention periods, 
d School closed for snow, 
e post-intervention probes. 




